
The Vector Between the Centroids of pupil and corneal reflections is computed and then used to compute 
the direction of gaze and the gaze point. 


much as the image features of interest 
(the cornea and pupil) typically oc- 
cupy a small part of the camera frame, 
this ROI capability can be exploited to 
determine the direction of gaze at a 
high frame rate by reading out from 
the ROI that contains the cornea and 
pupil (but not from the rest of the 
image) repeatedly. 

One of the present algorithms ex- 
ploits the ROI capability. The algo- 
rithm takes horizontal row slices and 
takes advantage of the symmetry of 
the pupil and cornea circles and of 
the gray-scale contrasts of the pupil 
and cornea with respect to other 
parts of the eye. The algorithm deter- 
mines which horizontal image slices 
contain the pupil and cornea, and, on 
each valid slice, the end coordinates of 
the pupil and cornea. Information from 
multiple slices is then combined to ro- 
bustly locate the centroids of the pupil 
and cornea images. 

The other of the two present algo- 
rithms is a modified version of an older 
algorithm for estimating the direction 
of gaze from the centroids of the pupil 
and cornea. The modification lies in the 
use of the coordinates of the centroids, 
rather than differences between the co- 
ordinates of the centroids, in a gaze- 


mapping equation. The equation lo- 
cates a gaze point, defined as the inter- 
section of the gaze axis with a surface of 
interest, which is typically a computer 
display screen (see figure). The ex- 
pected advantage of the modification is 
to make the gaze computation less de- 
pendent on some simplifying assump- 
tions that are sometimes not accurate. 

This work was done by Ashit Talukder, 
John-Michael Morookian, and James Lambert 
of Caltech for NASA’s Jet Propulsion Labora- 
tory. Further information is contained in a 
TSP (see page 1). 


In accordance with Public Law 96-51 7, 
the contractor has elected to retain title to this 
invention. Inquiries concerning rights for its 
commercial use should be addressed to: 
Innovative Technology Assets Management 

JPL 

Mail Stop 202-233 
4800 Oak Grove Drive 
Pasadena, CA 91109-8099 
E-mail: iaoffice@jpl.nasa.gov 
Refer to NPO-30699, volume and number 
of this NASA Tech Briefs issue, and the 
page number. 
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Declarative modeling brings efficiency to encoded procedures and allows for guarantees on 
resource usage and time usage. 

NASA’s Jet Propulsion Laboratory, Pasadena, California 


By studying the Orbital Express mis- 
sion, modeling the spacecraft and sce- 
narios, and testing the system, a tech- 
nique has been developed that uses 
recursive decomposition to represent 
procedural actions declaratively, schema- 
level uncertainty reasoning to make un- 
certainty reasoning tractable, and light- 
weight, natural language processing to 
automatically parse procedures to pro- 
duce declarative models. 

Schema-level uncertainty reasoning 
has, at its core, the basic assumption that 
certain variables are uncertain, but not 
independent. Once any are known, then 
the others become known. This is im- 
portant where a variable is uncertain for 
an action and many actions of the same 
type exist in the plan. For example, if 
the number of retries to purge pump 
lines was unknown (but bounded) , and 
each attempt required a sub-plan, then, 


once the correct number of attempts re- 
quired for a purge was known, it would 
likely be the same for all subsequent 
purges. This greatly reduces the space of 
plans that needs to be searched to en- 
sure that all executions are feasible. 

To accommodate changing scenario 
procedures, each is ingested into a tabu- 
lar format in temporal order, and a sim- 
ple natural-language parser is used to 
read each step and to derive the impact 
of that step on memory, power, and com- 
munications. Then an ASPEN (Activity 
Scheduling and Planning Environment) 
model is produced based on this analy- 
sis. The model is tested and further 
changed by hand, if necessary, to reflect 
the actual procedure. This results in a 
great savings of time used for modeling- 
procedures. 

Many processes that need to be mod- 
eled in ASPEN (a declarative system) 


are, in fact, procedural. ASPEN includes 
the ability to model activities in a hierar- 
chical fashion, but this representation 
breaks down if there is a practically un- 
bounded number of sub-activities and 
decomposition topologies. However, if 
recursive decomposition is allowed, 
HTN-like encodings are enabled to rep- 
resent most procedural phenomena. 

For example, if a switch requires a vari- 
able (but known at the time of the at- 
tempt) number of attempts to switch on, 
one can recurse on the number of re- 
maining switch attempts and decompose 
into either the same switching activity 
with one less required attempt, or not de- 
compose at all (or decompose into a 
dummy task) , resulting in the end of the 
decomposition. In fact, any bounded 
procedural behavior can be modeled 
using recursive decompositions assum- 
ing that the variables impinging the dis- 
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junctive decomposition decision are 
computable at the time that the decision 
is made. This enables one to represent 
tasks that are controlled outside of the 
scheduler, but that the scheduler must 
accommodate, without requiring one to 


give a declarative model of the proce- 
dural behavior. 

This work was done by Caroline 
Chouinard, Daniel Tran, Grailing Jones, 
Van Dang, and Russell Knight of Caltech for 
NASA’s Jet Propulsion Laboratory. 


The software used in this innovation is 
available for commercial licensing. Please con- 
tact Daniel Broderick of the California Insti- 
tute of Technology at danielb@caltech.edu. 
Refer to NPO-45262. 


36 


NASA Tech Briefs, July 2010 


